Microcanonical quasi-stationarity of long-range interacting systems 

in contact with a heat bath 
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On the basis of analytical results and molecular dynamics simulations we clarify the nonequilib- 
rium dynamics of a long-range interacting system in contact with a heat bath. For small couplings 
with the bath, we show that the system can first be trapped in a Vlasov quasi-stationary state, then 
a microcanonical one follows, and finally canonical equilibrium is reached at the bath temperature. 
We demonstrate that, even out-of-equilibrium, Hamiltonian reservoirs microscopically coupled with 
the system and Langevin thermostats provide equivalent descriptions. Our identification of the key 
parameters determining the quasi-stationary lifetimes could be exploited to control experimental 
systems such as the Free Electron Laser, in the presence of external noise or inherent imperfections. 
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In recent years, systems characterized by interactions 
that slowly decay at large distances have considerably 
attracted the attention of experimental and theoreti- 
cal physicists. Plasmas, gravitational systems, two- 
dimensional vortices, wave-matter interaction systems, 
all fall in this category [1[ . Of particular interest to what 
follows is the case of the Free Electron Laser (FEL), a 
source of coherent radiation which is expected to out- 
perform traditional lasers thanks to the properties of a 
relativistic-electron lasing medium (see, e.g., [2[ and ref- 
erences therein). For these systems, the prevalence of 
long-range interactions over mechanisms acting on short- 
range scales implies an inefficiency of fast collision pro- 
cesses. This is in contrast with the assumptions underly- 
ing Boltzmann's derivation of the transport equation and 
brings to the fact that long-range interacting systems get 
easily stuck in (Vlasov) noncquilibrium quasi-stationary 
states (QSS) 0, H, H, II, ||. For instance, the possible 
observation of QSSs in FEL experiments is predicted on 
the basis of molecular dynamics simulations of isolated 
(microcanonical) Hamiltonian systems capturing the es- 
sential features of the FEL dynamics [7J]. From an ex- 
perimental point of view, it is crucial to recognize if a 
stable noncquilibrium picture survives in the presence of 
an external environme nt ( or inherent imperfections) act- 
ing on the system [a M, Ell 1 an( i which arc the parameters 
playing a key role in the determination of the QSSs life- 
times. In addition, a basic theoretical issue is whether 
a stochastic dynamics simulating a thermal bath (TB), 
e.g., of the Langevin type, reproduces the same noncqui- 
librium features of a Hamiltonian reservoir microscopi- 
cally interacting with the long-range system. 

While for short-range systems the equivalence between 
Hamiltonian and Langevin thermostats is well estab- 
lished, the connection between these two different de- 
scriptions for the noncquilibrium behavior of a long-range 
system is less clear, and recent simulations ll| recovered 



provide in fact an equivalent description of the behavior 
of a paradigmatic long-range system also in noncquilib- 
rium conditions. This is established, both analytically 
and numerically, analyzing the scaling properties of the 
QSSs lifetimes. We recast the interaction between the 
system and a Hamiltonian TB in terms of an equiva- 
lent set of generalized Langevin equations. The damping 
coefficient 7 determines the timescale tbath for the re- 
laxation to canonical equilibrium, achieved when system 
and TB share the same temperature. However, even in 
the presence of TB, correlations due to a slow collisional 
process determine another timescale t co u (depending on 
system size N) which corresponds to a relaxation to a 
microcanonical QSS. Thus, for 7 small enough and N 
not too large, our main result is the discovery of a novel 
picture for the transport to equilibrium: On a timescale 
tdyn ~ 1 (in dimcnsionlcss units) a violent relaxation 
drives the system into a Vlasov QSS; Then, on a timescale 
tcoii ~ N s (with 5 > 1) the system reaches a microcanon- 
ical QSS; Finally, on a timescale tbath ~ 1/7: the system 
crosses over to canonical (thermal) equilibrium. 

Thanks to its appealing (yet non-trivial) simplicity, a 
system which captured a paradigmatic interest among 
the researchers is the Hamiltonian Mean Field (HMF) 
model 0, 0, [a la la H Ell > which can be thought as a set 
of N globally coupled XY"-spins with Hamiltonian 
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the same results for the two TBs only at equilibrium. 
Here we demonstrate that Hamiltonian and Langevin TB 



where $i € [0, 2ir) are the spin angles and li = 0j € R 
their angular momenta (velocities). Defining the ki- 
netic temperature T = ^i=i 'I /-^ as twice the spe- 
cific kinetic energy and the specific magnetization as 
in = I ^ i=1 (cos^i,sin6'i)|/A f , one obtains the exact rela- 
tion E/N = T/2 + (l-m 2 )/2, where E is the total energy 
of the system. The free energy of the HMF model can 
be exactly mapped [3] onto that of the Colson-Bonifacio 



Hamiltonian model for the single-pass FEL [12J . In such 
a context, the variables Zj's are interpreted as the phase 
velocities relative to the center of mass of the N elec- 
trons and the 9i's are the electron phases with respect 
to the co-propagating wave [7[. Despite some dynami- 
cal and thermodynamic differencies, analogies can also 
be found between the HMF model and the behavior of 
one-dimensional self- gravitating systems [13l | . 

When the HMF model is isolated, in order to determine 
whether the system truly converges toward statistical 
equilibrium and the timescale of this relaxation, one must 
develop an appropriate kinetic theory. This is a classi- 
cal problem addressed, e.g., in [lj| and, more recently, in 
[9(. From the Liouvillc equation it is possible to derive 
the BBGKY hierarchy for the reduced joint probability 
density functions (PDF) pj (6\ , . . . , 9 3 ■ , 9\ , . . . , 9 3 ■,, t) , with 
j = 1,2,..., N. In the thermodynamic limit N — > oo, 
E/N ~ 1, and fixed volume V = 2ir, the hierarchy can 
be closed by considering a systematic expansion in pow- 
ers of 1/N of the solutions of the equations [j|. At the 
order 1/N, the distribution function / = Npi satisfies 
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where 0(0, t) = -± f™ d9' cos(6 - 9') J^ d9 f(8', 6, t). 
For TV — ► +oo, the r.h.s. of Eq. ([2|) is negligible and 
we get the Vlasov equation [lj|. For N finite, C co ii(f) 
is a "collision" operator taking into account correlations 
between particles Q. The scaling in Eq. ((2|) indicates 
that "collisions" (more properly correlations) operate on 
a very slow timescale, of the order Nt dyn or even larger 
when Ccoii(f) = 0, as for a spatially homogeneous one 
dimensional system [9[ . It is precisely because of the de- 
velopment of correlations that the system reaches, on the 
"collisional" relaxation time t co u , a microcanonical Boltz- 
mann distribution. Since t co ii{N) diverges for N — ► +oo 
(different scalings, t coU ~ Nt dyn , N 1 - 7 t dyn ,e N t dyn , have 
been reported depending on the initial conditions |l5|), 
the domain of validity of the Vlasov equation is huge. 
Starting from an out-of-equilibrium initial condition, the 
Vlasov equation develops a complicated mixing process 
in the single-particle phase space, leading, in most cases, 
to a QSS [a, [l5[ ■ This process is called violent relaxation 
since it takes place on a timescale t dyn ~ 1. The QSS is a 
nonlincarly dynamically stable stationary solution of the 
Vlasov equation on a coarse-grained scale Q . The Vlasov 
equation admits an infinite number of stationary solu- 
tions. The statistical theory of Lvnden-Bell tla | predicts 
the "most probable" (most mixed) state [1,Q. However, 
in view of the possible occurrence of incomplete relax- 
ations [J, Q , there are cases in which the QSSs take forms 
different from those described by Lynden-BelPs theory. 

The interaction of the system ([1]) with a reservoir has 
been studied in Refs. [8[ and 0] introducing a Hamilto- 
nian and a Langevin TB, respectively In the latter case, 
the dynamics of the system is governed by a set of N 
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FIG. 1: Caloric curve of the HMF model (solid line). The 
dashed line is the prolongation of the ordered phase to sub- 
critical energies. See text for details. 



coupled stochastic equations: 



Tfc + VW&W, 
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where F, = — -^ Ylj=i sm (0i — 9j) is the long-range force 
experienced by the spin i, 7 is a damping coefficient due 
to the interaction with the TB, T\, is the TB temperature, 
and £j is a Gaussian white noise satisfying (£»(£)) = 
and (&(*)&(*')) = 8ij5(t - t'). Eos. © define the so- 
called Brownian Mean Field model Q (see also [l(|)- The 
evolution of the iV-body PDF is governed in this case 
by the Fokker-Planck equation, from which a BBGKY- 
like hierarchy for the p,'s can be derived. In the ther- 
modynamic limit N — ► +00, Tf, ~ 1, V = 2-k ~ 1, 
the hierarchy can be closed by considering an expan- 
sion in powers of 1/N. It is possible to see [9| that 

p 2 (Mi, 02, to) = Pi (Mi) Pi (02, 2 ) + 0{\/N). Hence, 
for N — ► +00, the equation for / = Npi becomes the 
mean-field Kramers equation: 
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(4) 
equation relaxes to the canonical mean- 
Maxwell-Boltzmann distribution f(9, 6) = 
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field 

L e -(e 2 n+^(e))/T b [ with ^0) lim t _ oo 0(6l,t)] on a 

timescale tb a th ~ I/7, independent of N. For 7 = 
one recovers the microcanonical situation in which the 
system is isolated. Correspondingly, the Fokker-Planck 
equation becomes the Liouville equation and the mean 
field Kramers equation becomes the Vlasov equation. 

The numerical integration of Eqs. (O exhibits a very 
rich transport-to-equilibrium picture [ll| . In this Let- 
ter, we show that the key point for understanding the 
nonequilibrium behavior of the system is the comparison 
between the timescales td yn , t co ii and tbath- We specifi- 
cally analyze the time evolution of the magnetization of 
the system for simulations with random water bag initial 
conditions of the form: Pl {8, 6, 0) = 5(9 - O)[#(0 + 7) + 
•9(9 — i)]/2l ("d being the Hcaviside step function), where 
7 ~ 2.03. We thus have m(0) = 1, E(0)/N ~ 0.69, and 
T(0) = 1.38. These and similar nonequilibrium initial 
conditions have been largely studied in microcanonical 
simulations la. la . Ilal and recently discussed in the pres- 
ence of a TB 0, [llj • The initial energy of the system is 




io s iiy" io" io J ioW ur s id' iff" io J io° Y» 



FIG. 2: (Color online) Time evolution of the magnetization 
with a Langevin TB. The control parameters 7 = 10~ 7 ,5 x 
Kr 7 ,l(T 6 , N = 500,1000,5000 satisfy 7 < 1/W 1 ' 7 < 1. 
Plots are averages over at most 10 runs. The system reaches 
a Vlasov QSS for t ~ tdyn ~ 1, a microcanonical QSS for t 



N and a canonical equilibrium for t ~ tf, a t 



I/7. 



this latter case, the system reaches a canonical equilib- 
rium state with temperature T = T b , without forming 
any (Vlasov or microcanonical) QSS. This corresponds 
to the overdamped (Smoluchowski) regime studied in [9(. 
In conclusion, the limits t — >oo,./V— >oo,7^0do 
not commute. Depending on the order in which they are 
taken, the average value of the magnetization can be the 
Vlasov (JV — ► 00 and 7-^0 before t — > 00), the mi- 
crocanonical (7 — ► and t — > co before N — > 00), or 
the canonical one (N — > 00 and t — * 00 before 7 — ► 0). 
The simulations reported in Fig. [2] demonstrate these 
features. In Fig. [3^ curves with the same N almost co- 
incide for t < tcoii't Those with the same 7 collapse onto 
each other for t > t co u . The presence of a microcanonical 
QSS following the Vlasov one is particularly evident in 
the rescaled plots of Figs. [2b, c, which confirm the scaling 
properties of t coU and t hath . 

The next step is to establish whether these micro- 
canonical QSSs are an artifact of the mesoscopic stochas- 
tic dynamics (J3J) or if they are still present when we con- 
sider a Hamiltonian TB microscopically coupled with the 
long-range system. In Ref. [8| a first-neighbors coupled 
ATF-spins TB has been introduced, 



below the critical point E c /N = 3/4 (see Fig. [TJ. Micro- 
canonical simulations (7 = 0) display, in a time td yn ~ 1, 
a violent relaxation process in which the magnetization 
drops to ?7i ~ + 0(l/y/~N) and the temperature to 
T ~ 0.38. A QSS lasting a time of the order t coU ~ N s 
follows the violent relaxation [lj|. After the QSS, the 
isolated system warms up (at fixed energy) due to finite- 
size effects, and finally reaches the microcanonical equi- 
librium state with T ~ 0.475 and m ~ 0.31. At variance, 
in a relaxation process at fixed temperature T& = 0.38 
(canonical simulations with 7 ^ 0), the system reaches a 
canonical equilibrium state with T = Xj,, E/N ~ 0.487, 
and m ~ 0.64 (see again Fig. [TJ). Hence, if we fix the 
TB temperature in Eq. © at T b = 0.38, and let 7^0, 
there is an apparent discontinuity in the final equilibrium 
value of the magnetization [111]. Actually, this paradox 
is solved by the presence of a second QSS which follows 
the Vlasov one. Indeed, for t ^C thath ~ 1/7 the energy 
is relatively well conserved. Thus, if td yn "C t co u ^C hath 
(i.e. 7 -C 1/N S <C 1), the magnetization of the sys- 
tem relaxes to the microcanonical value m ~ 0.31 on 
the collisional timescale t co u ~ N s (we find 5 ~ 1.7, 
independently of 7). This is the reason why we call 
this second quasi-equilibrium state the "microcanonical 
QSS". The equilibrium with the TB, and the consequent 
value m ~ 0.64, is established only on the much larger 
timescale t bath . On the contrary, for t dyn < t bath < t co ii 
(i.e. 1/N S <7< 1), the system first reaches a Vlasov 
QSS on a timescale td V m then a canonical equilibrium 
state with temperature T = T b on a timescale tbathi an d 
does not form a microcanonical QSS. We note that in or- 
der to see the microcanonical QSS we need a very small 
noise level: 7 <C 1/N S . There is a further interesting 
situation, obtained for tbath "C td yn (i-e. 7 » 1). In 



Htb = / J 



N T b jTB^ N T b 



E[i 



qTB a TB 



)] , (5) 



8=1 1 = 1 

interacting with the HMF model through the potential 
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where r s (i) are integer independent random numbers in 
the interval [1, Ntb]- Each HMF-spin is in contact with 
a set of S different TB-spins chosen randomly along the 
chain, and the coupling constant e > determines the 
interaction strength between system and TB. The condi- 
tions [| N TB = N 2 and S = lO 5 ^" 1 / 2 assure that for 
large N the interaction, the system, and the TB ener- 
gies are well separated. Molecular dynamics simulations 
of the Hamiltonian Hhmf + Htb + Hj were shown to 
agree with the Langevin ones at equilibrium [ll| , whereas 
the presence of QSSs with a lifetime depending on both 
e and N (or, cquivalently, S) has been detected |a.[ll|. 

In order to clarify this dependence we study a differ- 
ent Hamiltonian form for the TB and for its interaction 
with the system, which has the advantage of allowing an 
explicit analytical analysis. Following the approach out- 
lined by Zwanzig [17j | for short-range systems, our aim is 
to recast the Hamiltonian equations of motion in a form 
similar to Eqs. ([3]). Hence, we replace Eqs. (|5I6[) with 
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respectively, and consider the Hamiltonian Hhmf + 
H TB + H'j. The TB in Eqs. describes a set of 
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FIG. 3: (Color online) Time evolution of m with the Hamil- 
tonian TB in Eqs. (|5I6[) . In (a,b) the control parameters 
are e = 0.1,0.05,0,01; N = 500,1000,5000; S = 10 5 iV" 1/2 . 
We found h = e 3 ' 2 S. In (c) the longer simulations are with 
e = 10~ 3 , 10~ 4 ; N = 500. Averages are over at most 10 runs. 



Ntb isochronous harmonic oscillators in their canonical 
coordinates, which interact with the system through a 
quadratic potential. This quadratic form can be thought 
as a small-angles expansion of Eq. ((5]), and again each 
element of the HMF model interacts with S different TB 
oscillators. Using for example the Laplace transform and 
performing then an integration by parts, the Hamiltonian 
dynamics of the #j's becomes 



i(t) = Fi- dtK(t - t) 9i(r) + £'(*), 



(8) 



where K(t) = ^J2i=i LJ rji) cos [v^ w >' s (?:)i] , and£' can be 
written explicitly in terms of the initial conditions [l9(. 
Assuming a random distribution for the initial data, £' 
can be regarded as a stochastic term. On the other hand, 
if is a memory kernel which depends on e, S, and on the 
distribution of the frequencies w r m. Specifically, when 
K reduces to a <5-function, Eq. (jSJ recasts into Eq. ([3|) 
with 7 = h(e, S), and h a model-dependent function. The 
form of equations {5} suggests that the relaxation process 
in the presence of a general Hamiltonian TB should be 
analogous to that described by the stochastic Langevin 
Eqs. ([3]), with the canonical equilibrium established on a 
timescale tbath = [h{t, S)]~ l . In particular, by choosing 
sufficiently small e's, the system should exhibit micro- 
canonical QSS also if coupled with a Hamiltonian TB. 
We verified these conclusions for the Hamiltonian TB in 
Eqs. (|5I6[) . Figs. [3^,,b demonstrate that if we rescale 
the time by h(e, S) = e 3 ' 2 S indeed the relaxation time 
to the thermal equilibrium obtained for different e's and 
S's collapse onto the same value. Moreover, for e < 10 -3 
microcanonical QSSs clearly appear (Fig. [3k). 

In summary, we have shown that the nonequilibrium 
dynamics of a paradigmatic long-range system which 
can be mapped onto the one describing the single-pass 
FEL is characterized by the three timescales td yn ~ 1, 
tcoii ~ N s , t ba th ~ I/7. By acting on the initial con- 
ditions, on the system size N, or on the coupling with 
the heat bath 7, one can conceive experiments in which 
the system is cither in equilibrium with the bath or in 
a quasi-cquilibrium state with a dynamical temperature 
which is different from the temperature of the thermal 
environment. This situation could inspire interesting ap- 
plications and provides a control on the imperfections 
influencing a FEL and other long-range systems. 
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For this m(0) = 1 initial condition, the Vlasov QSS is 
not described by the Lynden-Bell theory because of in- 
complete relaxation (see [J, @])- 

*'(*) = eEii<(i){K? O (0) 

where fi(t) = cos( v / ei^r a ( 
sin (Vew r ,(i)t) /y/ew Tt (i). 
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